home *** CD-ROM | disk | FTP | other *** search
/ MacWorld 1999 February / Macworld (1999-02).dmg / Shareware World / Shareware Feature / NetPresenz 4.1 / Showcase / tricky / robots / robots.txt < prev   
Encoding:
Text File  |  1996-01-30  |  224 b   |  10 lines  |  [TEXT/ttxt]
  1. # robots.txt file
  2. # 
  3. # purpose to World Wide Web Robots trawling your web site (or parts thereof)
  4. # 
  5. # For more info consult:
  6. #   http://info.webcrawler.com/mak/projects/robots/norobots.html
  7.  
  8. User-agent: *
  9. Disallow: /local/
  10.